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1 SYSTEM AND METHOD FOR MULTIMEDIA ENCRYPTION 

2 

3 The United States Government has rights in this invention pursuant 

4 to Contract No. W-7405-ENG-48 between the United States Department of 

5 Energy and the University of California for the operation of Lawrence 

6 Livermore National Laboratory. 
7 

8 BACKGROUND OF THE INVENTION 

9 1. Field of the Invention 

10 The present invention relates generally to systems and methods for 

11 encryption, and more particularly for multimedia encryption. 

12 2. Discussion of Background Art 

13 Transmission of audio and video signals, such as video conferencing 

14 and security surveillance signal, across both local and wide area networks is 

15 becoming more and more commonplace in today's globally interconnected 

16 internet driven economy. In such applications, encryption is often required 

17 for protecting and authenticating such multimedia signals as they travel over 

18 unsecured networks. For instance, corporations often exchange business 

19 sensitive information during such conferences which must not be 

20 intercepted. Additionally, multimedia information from networked security 

21 camera systems must be authenticated and protected from unauthorized 

22 monitoring. 
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1 A degree to which encr3rption authenticates and protects multimedia 

2 data depends on the encryption schema used, an encryption key length, the 

3 predictability of the encryption key, and how the encryption keys are 

4 protected. Typically, encryption keys are generated by hashing algorithms 

5 from random number seeds provided by a source which hopefully provides 

6 random number seeds. Random number seeds, however, are extremely 

7 difficult if not impossible to generate using algorithmic methods on digital 

8 computers, since algorithms executing on digital computers are by nature 

9 deterministic. As a result, various external chaotic sources have been used to 

10 generate the random number seeds. 

11 Examples include methods described in U.S. Patent 5,732,138 entitled, 

12 '"Method For Seeding A Pseudorandom Number Generator With A 

13 Cr);ptographic Hash Of A Digitization Of A Chaotic System,'" by Noll et al., 

14 and U.S. Patent 5,774, 549 entitled, ''Method And Apparatus That Processes A 

15 Video Signal To Generate A Random Number Generator Seed'' b y Takob 

16 Nielsen . 

17 Noll discusses generating seeds by applying a hashing algorithm to a 

18 digitized chaotic system. Chaotic systems mentioned include clouds moving 

19 in the sky, ocean waves crashing on a shoreline, and nodules moving within 

20 a 'Tava-lamp/' A weakness of the Noll system, however, is that in his 

21 preferred embodiment, new seed generation depends upon using dedicated 

22 input devices to monitor "real-world scenes," such as a video camera 
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1 monitoring a lava-lamp, in order to obtain the necessary chaotic input for 

2 eventual random number generation. 

3 Nielsen also requires dedicated input devices, such as a video camera. 

4 Nielsen monitors "live"' scenes with a video camera and then generates 

5 seeds from pixel changes within sequential frames of video data. A weakness 

6 of the Nielsen system is that new seeds are not generated when motion 

7 within a monitored scene stops. 

8 In response to the concerns discussed above, what is needed is a system 

9 and method for multimedia encryption that overcomes the problems of the 
10 prior art. 
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1 SUMMARY OF THE INVENTION 

2 The present invention is a system and method for multimedia 

3 encryption. Within the system of the present invention, a data compression 

4 module receives and compresses a media signal into a compressed data 

5 stream, A data acquisition module receives and selects a set of data from the 

6 compressed data stream. And, a hashing module receives and hashes the set 

7 of data into a keyword. 

8 In other aspects of the invention, the system may include a data 

9 compression module that compresses the media signal into any compression 

10 format that has varying length data frames. Examples of media compression 

11 formats that with varying length data frames include MPEGl, MPEG2, 

12 MPEG4, MJPEG, and H.261. The set of data can be one frame of data, cross 

13 over several frame boundaries, include compression transform coefficients, 

14 include predictive data frames. Finally, a pseudo-random number generator 



15 can processes a single keyword seed in to a set of keywords. 

16 The method of the present invention includes the steps of compressing 

17 a media signal into a compressed data stream; selecting a set of data from the 

18 compressed data stream; and hashing the set of data into a keyword. 

19 The system/ apparatus and method of the present invention are 

20 particularly advantageous over the prior art because a means of capturing 

21 random numbers for encrj^tion seeding directly from variable frame 

22 boundary compressed data is disclosed. In light of a growing importance in 
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1 securely transmitting multimedia data over digital networks, obtaining 

2 random numbers directly from the multimedia data would be very useful. 

3 These and other aspects of the invention will be recognized by those 

4 skilled in the art upon review of the detailed description, drawings, and 

5 claims set forth below. 
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1 BRIEF DESCRTPTION OF THE DRAWINGS 

2 Figure 1 is a block diagram of a system for multimedia encryption 

3 according to the present invention; 

4 Figure 2 is a graphical depiction of quantization processes within an 

5 analog-to-digital converter within the system; 

6 Figure 3 is a block diagram of a computer within the system; 

7 Figure 4 is a graphical depiction of how a data acquisition module 

8 operates within the system; and 

9 Figure 5 is a flowchart of a method for multimedia encryption. 
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1 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

2 Figure 1 is a block diagram of a system 100 for multimedia encryption 

3 according to the present invention. Within the system 100, a transducer 102, 

4 such as a video camera, a radio, a nricrophone, a Geiger counter, or an 

5 electrical component, outputs a media signal 104. 

6 The media signal 104 may or may not contain useful information, such 

7 as an actual video scene or audio output, and the present invention does not 

8 require that useful information be present. For example, while a video 

9 camera could be capturing a scene, this is not required, and instead a lens-cap 

10 could be on the camera causing the scene to be perfectly quiescent. In one 

11 embodiment of the present invention, the media signal need only include 

12 random transducer noise having a noise signal amplitude. Random noise is 

13 not the same a chaotic noise. Random noise, such as white Gaussian noise, is 

14 completely unpredictable from one moment to a next, while chaotic noise is 

15 highly predictable over short time periods. In a second embodiment of the 

16 invention, however, random transducer noise need not even be present. 

17 Instead, data compression techniques provide a basis for multimedia 

18 encryption, as will be elaborated upon below. 

19 The media signal 104 from the transducer 102 is fed into an analog-to- 

20 digital (A/D) converter 106. The converter 106 quantizes the media signal 

21 with a quantization step size smaller than the noise signal amplitude within 

22 the media signal 104, creating a quantized media signal 108. The quantized 

23 media signal 108 is then routed to a computer 110. 
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1 

2 Figure 2 is a graphical depiction of quantization processes within the 

3 analog-to-digital converter 106 within the system 100. The media signal 104 is 

4 periodically sampled 202. The samples 202 are then quantized at predefined 

5 steps 204 resulting in the quantized media signal 108. The quantized media 

6 signal 108 is a quantized approximation of the media signal 104 containing 

7 random transducer noise. The random noise in the media signal 104 will 

8 cause even unchanging video scenes to have quantization values 206 which 

9 fluctuate for media signal values close to one or more quantization steps 204. 

10 Thus, even a perfectly quiescent media signal 104 (e.g. when a lens cap is on a 

11 video camera containing the transducer 102) will contain some randomness 

12 from random transducer noise. Put another way, as long as a size of a 

13 smallest quantizer step is no larger than an amplitude of the transducer 102 

14 noise, the quantized media signal 108 will include a high level of randomness 

15 even if input to the transducer is perfectly quiescent. 

16 Typically, the transducer noise is sufficient to cause the quantization 

17 values 206 to fluctuate. However, if the transducer noise is small relative to 

18 the quantization steps 204, then either video or audio content of the media 

19 signal 104 must vary somewhat so that what little noise is in the scene will 

20 enable random noise to be quantized by the A/D converter 106. Randomness 

21 will be present in the media signal 104 when an actual sampled media signal 

22 value 208 is very close to a quantization boundary 210. When this occurs, a 

23 small transducer 102 signal will randomly cause the quantized media signal 
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1 108 to vary. It is possible to test whether sufficient random noise is present 

2 within the media signal 104 by looking at least significant bits of the media 

3 signal 104 and ensuring that no long sequences of a single bit value (i.e. ones 

4 or zeros) exist. Long sequences of zeros or ones in a least significant bit of the 

5 media signal 104 wovild suggest that the random noise is not of a sufficient 

6 ampHtude to create random numbers. 

7 In an alternate embodiment, distortion may be introduced into the 

8 media signal 104 generated by the transducer 102 such that the random 

9 transducer noise will have an amplitude greater than the quantization steps 

10 204. Distortion may be introduced, for example, in a video camera by turning 

11 on an automatic gain control and increasing video camera gain. In another 

12 embodiment, focus and zoom of the camera can be varied while capturing 

13 video data. 
14 

15 Figure 3 is a block diagram 300 of the computer 110 within the system 

16 100. Within the computer 110, a data compression module 302 compresses the 

17 quantized media signal 108 into a compressed data stream 303 using any 

18 number of formats, such as MJPEG, MPEGl, MPEG2, MPEG4, or H.261. Many 

19 other standard, as well as proprietary, media compression schemes also exist 

20 that are compatible with the present invention. 

21 The compressed data stream 303 is partitioned into data frames of 

22 varying length, depending upon an amount of information contained in the 

23 media signal 104, variations in a scene or audio captured by the transducer 
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1 102, transducer noise, and system noise. For example, a 16384 byte amount of 

2 data acquired from an MPEGl compressed data stream can include between 

3 one and eight frames of media data of varied length. For comparison, 

4 uncompressed media signals generally have a frame length which is fixed in 

5 size. For instance, imcompressed digital video signals include a series of fixed 

6 sized digital video images. 

7 Under some compression schemas, the compressed data stream 303 

8 includes predictive data frames. Predictive data frames only contain 

9 information which reports on differences between a current data frame and a 

10 most recent full data frame. Predictive data frames typically include motion 

11 vectors and error codes. Identical motion vectors and error codes between 

12 full frames indicate an absence of any video motion, audio, or transducer 

13 noise. 

14 The compressed data stream 303 also can include compression 

15 transform coefficients, frame sequence numbers, and cyclic redundancy 

16 checks which vary from frame to frame. Identical transform coefficients 

17 between full frames indicate an absence of any video motion, audio, or 

18 transducer noise. 

19 In response to a key request 304 received from an external source (not 

20 shown), a control module 306 instructs a data acquisition module 308 to 

21 collect a set of data 309 from the compressed data stream 303. The data 

22 acquisition module 308 operating in conjunction with the data compression 

23 module 302 creates a robust source of random numbers in the set of data 309. 
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1 This is due to unpredictable variability between the compressed data stream 

2 303 and random selection of the set of data 309 therefrom. 

3 In an alternate embodiment, the data acquisition module 308 can be 

4 instructed to collect the set of data 309 directly from the quantized media 

5 signal 108 output by the A/D converter 106 before any data compression. An 

6 amoimt of data collected is dependent upon an amount of uncertainty 

7 required for a given application. A good rule of thumb is to capture an 

8 amotmt of data greater than or equal to a compressed full frame. However, 

9 when a large amount of noise is present in the media signal, a lesser amount 

10 of the media signal data needs to be collected. 

11 A message digest generator 310 receives and processes the set of data 

12 309 with a hashing algorithm. The message digest generator 310 generates a 

13 fixed-length unique identifier 311 for each pattern of bits in the set of data 309. 

14 Hashing algorithms assure that the resultant identifier 311 varies significantly 

15 even if the set of data 309 only varies by one bit. It is computationally 

16 infeasible to reconstruct the set of data 309 from only knowledge of the 

17 identifier 311. This identifier 311 is also called a keyword seed. 

18 An encryption key generator 312 is a pseudo-random number 

19 generator that receives and processes the identifier 311 into a set of keywords 

20 to be immediately used or stored in a memory 314 for later use. 
21 

22 Figure 4 is a graphical depiction 400 of how the data acquisition module 

23 308 operates within the system 100. Shown is a typical compressed 
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1 multimedia data stream 402. The data stream 402 includes compressed audio, 

2 video, and control data separated by frame boundaries 404. Each frame of data 

3 has a length, such as video data 406, which has a length 408. Within the 

4 multimedia data stream, lengths of each frame vary randomly, depending on 

5 a compression ratio as well as other well known compression algorithm 

6 factors. The data acquisition module 308 acquires a set of data 410 from the 

7 compressed data stream 303 without regard to any of these factors. 

8 Thus, the set of data 410 can cross over the frame boundaries 404 in a 

9 random manner, resulting in a highly random, and impredictable set of data 
10 309. The set of data 309 thus can function as a robust keyword seed. 

11 

12 Figure 5 is a flowchart 500 of a method for multimedia encryption. The 

13 method begins in step 502 where the transducer 102 receives a media signal 

14 which may include a noise signal amplitude. In step 504, the A/D converter 

15 106 quantizes the media signal with a quantization step size smaller than the 

16 noise signal amplitude. The data compression module 302 compress the 

17 media signal into data frames having data frame boundaries, where the data 

18 frames may have similar or varying lengths, include compression transform 

19 coefficients, and/or include predictive data frames in step 506. Next, in step 

20 508, the data acquisition module 308 selects a set of data from the compressed 

21 media signal, such that the data selected may include one frame of data, data 

22 which crosses over several data frame boundaries, compression transform 

23 coefficients, and /or predictive data firames. In step 510, the message digest 
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1 generator 310 hashes the set of data into a keyword. After step 510, the 

2 method is complete. 
3 

4 While the present invention has been described with reference to a 

5 preferred embodiment, those skilled in the art will recognize that various 

6 modificatioiTS may be made. Variations upon and modifications to the 

7 preferred embodiment are provided by the present invention, which is 

8 limited only by the following claims. 
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WHAT TS C.T.ATMED IS: 
11. A system for multimedia encryption comprising: 

2 a media signal; 

3 a data compression module coupled to receive and compress the media 

4 signal into a compressed data stream; 

5 a data acquisition module coupled to receive and select a set of data 

6 from the compressed data stream; and 

7 a hashing module coupled to receive and hash the set of data into a 

8 keyword. 

1 2. The system of claim 1 wherein the set of data is one frame of data 

2 within the compressed data stream. 

1 3. The system of claim 1 wherein the set of data crosses over several 

2 frame boundaries within the compressed data stream. 

1 4. The system of claim 1 wherein: 

2 the compressed data stream includes compression transform 

3 coefficients; and 

4 the set of data includes a set of compression transform coefficients. 

1 5. The system of claim 1 wherein: 

2 the compressed data stream includes data frames of varying length; and 
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3 the set of data includes a set of data frames. 

1 6. The system of claim 1 wherein: 

2 the compressed data stream includes predictive data frames; and 

3 the set of data includes a predictive data frame. 

1 7. The system of claim 1: 

2 wherein the media signal includes a noise signal amplitude; 

3 further comprising, 

4 an analog to digital converter, having a quantization step size 

5 smaller than the noise signal amplitude, coupled to receive and 

6 quantize the media signal; and 

7 wherein the data compression module compresses the quantized 

8 media signal into a compressed data stream. 

1 8. The system of claim 1 wherein the data compression module 

2 compresses the media signal into one from a group consisting of: MJPEG, 

3 MPEGl, MPEG2, or MPEG4, H.261, H.320, and H.323 formats. 

1 9. The system of claim 1 further comprising: 

2 a pseudo-random number generator coupled to receive and process the 

3 keyword in to a set of keywords. 



15 



1 10. A method for multimedia encryption, comprising the steps of: 

2 compressing a media signal; 

3 selecting a set of data from the compressed media signal; and 

4 hashing the set of data into a keyword. 

1 11. The method of claim 10 wherein: 

2 the compressed media signal includes data frames; and 

3 the selecting step includes the step of selecting one frame of data. 

1 12. The method of claim 10 wherein: 

2 the compressed media signal includes data frames and data frame 

3 boundaries; and 

4 the selecting step includes the step of selecting a set of data which 

5 crosses over several data frame boundaries. 

1 13. The method of claim 10 wherein: 

2 the compressed media signal includes compression transform 

3 coefficients; and 

4 the selecting step includes the step of selecting a set of compression 

5 transform coefficients. 

1 14. The method of claim 10 wherein: 
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2 the compressed media signal includes data frames of varying length; 

3 and 

4 the selecting step includes the step of selecting a set of data frames. 

1 15. The method of claim 10 wherein: 

2 the compressed media signal includes predictive data frames; and 

3 the selecting step includes the step of selecting a predictive data frame. 

1 16. The method of claim 10: 

2 wherein the media signal includes a noise signal amplitude; 

3 further comprising the step of quantizing the media signal with a 

4 quantization step size smaller than the noise signal amplitude; and 

5 wherein the compressing step includes the step of compressing the 

6 quantized media signal. 

1 17. A system for multimedia encryption, comprising: 

2 means for compressing a media signal; 

3 means for selecting a set of data from the compressed media signal; and 

4 means for hashing the set of data into a keyword. 

1 18. The system of claim 17 wherein: 

2 the compressed media signal includes data frames; and 

3 the means for selecting includes means for selecting one frame of data. 
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1 19. The system of claim 17 wherein: 

2 the compressed media signal includes data frames and data frame 

3 boundaries; and 

4 the means for selecting includes means for selecting a set of data which 

5 crosses over several data frame boundaries. 



1 20. The system of claim 17 wherein: 

2 the compressed media signal includes compression transform 

3 coefficients; and 

4 the means for selecting includes means for selecting a set of 

5 compression transform coefficients. 

1 21. The system of claim 17 wherein: 

2 the compressed media signal includes data frames of varying length; 

3 and 

4 the means for selecting includes means for selecting a set of data 

5 frames. 



1 22. The system of claim 17 wherein: 

2 the compressed media signal includes predictive data frames; and 

3 the means for selecting includes means for selecting a predictive data 

4 frame. 
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1 23. The system of claim 17: 

2 wherein the media signal includes a noise signal amplitude; 

3 further comprising means for quantizing the media signal with a 

4 quantization step size smaller than the noise signal ampHtude; and 

5 wherein the means for compressing includes means for compressing 

6 the quantized media signal. 

1 24. A computer-useable medium embodying computer program code for 

2 multimedia encryption by executing the steps of: 

3 compressing a media signal; 

4 selecting a set of data from the compressed media signal; and 

5 hashing the set of data into a keyword. 

1 25. The computer-useable medium of claim 24 wherein: 

2 the compressed media signal includes data frames; and 

3 the selecting step includes the step of selecting one frame of data. 

1 26. The computer-useable medium of claim 24 wherein: 

2 the compressed media signal includes data frames and data frame 

3 boundaries; and 

4 the selecting step includes the step of selecting a set of data which 

5 crosses over several data frame boundaries. 
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1 27. The computer-useable medium of claim 24 wherein: 

2 the compressed media signal includes compression transform 

3 coefficients; and 

4 the selecting step includes the step of selecting a set of compression 

5 transform coefficients. 

1 28. The computer-useable medium of claim 24 wherein: 

2 the compressed media signal includes data frames of varying length; 

3 and 

4 the selecting step includes the step of selecting a set of data frames. 

1 29. The computer-useable medium of claim 24 wherein: 

2 the compressed media signal includes predictive data frames; and 

3 the selecting step includes the step of selecting a predictive data frame. 

1 30. The computer-useable medium of claim 24: 

2 wherein the media signal includes a noise signal ampUtude; 

3 further comprising the step of quantizing the media signal with a 

4 quantization step size smaller than the noise signal amplitude; and 

5 wherein the compressing step includes the step of compressing the 

6 quantized media signal. 
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1 SYSTEM AND METHOD FOR MULTIM F.TOTA F.NCRYPTION 

2 ABSTRACT QE THE DISCLOSURE 

3 A system and method is disclosed for multimedia encryption. Within 

4 the system of the present invention, a data compression module receives and 

5 compresses a media signal into a compressed data stream. A data acquisition 

6 module receives and selects a set of data from the compressed data stream. 

7 And, a hashing module receives and hashes the set of data into a keyword. 

8 The method of the present invention includes the steps of compressing a 

9 media signal into a compressed data stream; selecting a set of data from the 
10 compressed data stream; and hashing the set of data into a keyword. 



21 



S3 

=p 
Cj 
ill 

c:j 

iij 

u 

m 
4: 





goo 



Start 
Encryption 
Routine 



Acquire a media signal which may include a noise signal amplitude 



Quantize the media signal with a quantization step size smaller than the noise 

signal amplitude 



Compress the media signal into data frames having data frame boundaries, where 
the data frames may have similar or varying lengths, include compression 
transform coefficients, and/or include predictive data frames 



'504 



Select a set of data from the compressed media signal, such that the data selected 
may include one frame of data, data which crosses over several data frame 
boundaries, compression transform coefficients, and/or predictive data frames 



^0$ 



Hash the set of data into a keyword 



c End 



COMBINED DECLARATION AND POWER OF ATTORNEY 



■ Declaration submitted Attorney Docket: IL- 10360 

with Initial Filing Applicant: Douglas R. Coffland 

□ Declaration submitted Serial No.: 

after Initial Filing (surcharge Filing Date: 
(37 CFR 1.16(e)) required) 

As a below named in venter (s), I (we) hereby declare that: 

My (Our) residence, post office address and citizenship(s) are as stated below next to my (our) 
name(s). 

I believe I am the original, first and sole inventor (if only one name is listed below) or an 
original, first and joint inventor (if plural names are listed below) of the subject matter which is claimed 

and for which a patent is sought on the invention entitled: 

System and Method for Multimedia Encryption 

the specification of which (check one) 

X is attached hereto was filed on as United States Application Number 

or PCT International AppUcation Number 

and was amended on (if applicable). 

I (We) hereby state that I (we) have reviewed and understand the contents of the above- 
identified specification, including the claims, as amended by any amendment referred to above. 

I (We) acknowledge the duty to disclose information which is material to patentabihty as 
defined in 37 CFR 1.56. 

I (We) hereby claim foreign priority benefits under 35, U.S.C. 119(a)-(d) or 365(b) of any 
foreign application(s) for patent or inventor's certificate, or 365(a) of any PCT international application 
which designated at least one country other than the United States of America, listed below and have 
also identified below, by checking the box, any foreign application for patent or inventor's certificate, 
or of any PCT international application having a filing date before that of the application on which 
priority is claimed. 

Prior Foreign Application(s) Priority Not Claimed 

□ 

(Application Number) (Country) (Foreign Filing Date) 

□ 

(Application Number) (Country) (Foreign Filing Date) 

I (We) hereby claim the benefit under 35 U.S.C. 1 19(e) of any United States provisional 
application(s) Usted below: 

Application Serial No. Filing Date 



Application Serial No. 



Filing Date 



I (We) hereby claim the benefit under 35 U.S.C. 120 of any United States applications(s), or 
365(c) of any PCT international application designating the United States of America, listed below 
and, insofar as the subject matter of each of the claims of this application is not disclosed in the prior 
United States or PCT international application in the manner provided by the first paragraph of 35 
U.S.C. 112, 1 acknowledge the duty to disclose information which is material to patentability as 
defined in 37 CFR 1.56 which became available between the fiUng date of the prior application and the 
national or PCT international filing date of tiiis application. 



Application Serial No. 


Filing Date 




Status 


POWER OF ATTORNEY: As the named inventor(s), I (we) hereby appoint the following 
registered practitioner(s) to prosecute this application and to transact all business in the Patent and 
Trademark Office connected therewith. 


Names 


Registration No. 


Lloyd E. Dakin, Jr. 
John P. Wooldridge 


38,423 
38,725 




Direct Correspondence To: 
Lloyd E. Dakin, Jr. 
Assistant Laboratory Counsel 
Lawrence Livermore National Laboratory 
P.O. Box 808 - L-703 
Livermore, California 94551 


Direct Telephone Calls To: 
(Name and Telephone Numbers) 

Lloyd E. Dakin, Jr. 
(925) 423-8554 



I (We) hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be true; and further that these statements 
were made with the knowledge that willful false statements and the like so made are punishable by fine 
or imprisonment, or both, under 18 U.S.C. 1001 and that such willful false statements may jeopardize 
the validity of the application or any patent issued thereon. 



Douglas R. Coffland 




Full Name of Inventor 




Livermore, California 




Residence (City, State or Foreign Country) 




5674 Wisteria Way, Livermore, CA 94550 


USA 


Postal Address (Street, City, State, Zip Code) | Citizenship 


xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx?^^ 






Full Name of Inventor 


Signature 






Residence (City, State or Foreign Country) 


Date 






Postal Address (Street, City, State, Zip Code) 


Citizenship 


xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 



